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j^ , Abstract. This paper studies three kinds of long-term behaviours, namely reach- 

ability, repeated reachability and persistence, of quantum Markov chains (qMCs). 
As a stepping-stone, we introduce the notion of bottom strongly connected com- 
f*"*) . ponent (BSCC) of a qMC and develop an algorithm for finding BSCC decompo- 

C*") ' sitions of the state space of a qMC. As the major contribution, several (classical) 

algorithms for computing the reachability, repeated reachability and persistence 
' ^ ' ■ probabilities of a qMC are presented, and their complexities are analysed. 

£h ■ 1 Introduction 

^ ■ Verification problem of quantum systems are emerging from qu antum physics, quantum 

O"^ communication and quantum computation. For example, verification has been identified 

by physicists as one of the major short-term goals of quantum simulation [4]. Some ef- 
fective verification techniques for quantum cryptographic protocols have recently been 
>> i developed Ifl2l . J6), based on either quantum process algebras 031 . IfTTI . ||8l, |9ll or 

v ^2 | quantum model-checking ff3l . Also, several methods for verifying quantum programs 

ll20ll have been proposed, including quantum weakest preconditions (7) and quantum 

( — - , Floyd-Hoare logic [23 1. 

A quantum Markov chain (qMC) is a quantum generalisation of Markov chain (MC) 
where, roughly speaking, the state space is a Hilbert space, and the transition probabil- 

^) ■ ity matrix of a MC is replaced by a super-operator, which is a mathematical formal- 

ism of the discrete-time evolution of (open) quantum systems. qMCs have been widely 
employed as mathematical model of quantum noise in physics iflOl and as model of 
communication channels in quantum information theory IfTTI . A special class of qMCs, 
namely quantum walks, has been successfully used in design and analysis of quantum 
algorithms (TJ. Recently, the authors ||24] introduced a model of concurrent quantum 
programs in terms of qMCs as a quantum extension of Hart-Sharir-Pnueli's Markov 
chain model of probabilistic concurrent programs 11141 . This paper considers the verifi- 
cation problem of qMCs. 

Reachability analysis is at the central of verification and model-checking of both 
classical and probabilistic systems. Reachability of quantum systems was first studied 
by physicists |fl9l within the theme of quantum control , but they only considered states 
reachable in a single step of evolution. In [24], reachability of qMCs was considered, 
and it was used in termination checking of concurrent quantum programs. However, 
reachability studied in [241 can be properly described as qualitative reachability be- 
cause there only algorithms for computing reachable subspaces but not reachability 
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probabilities were developed. This paper is a continuation of j24l and aims at quantita- 
tive reachability analysis for qMCs. More precisely, the main purpose of this paper is to 
develop (classical) algorithms for computing the reachability, repeated reachability and 
persistence probabilities of qMCs. 

Reachability analysis techniques for classical MCs heavily depends on algorithms 
for graph-reachability problems, in particular for finding bottom strongly connected 
components (BSCCs) of the underlying graph of a MC (see |2] Section 10.1.2]). Such 
algorithms have been intensively studied by the graph algorithms community since 
early 1970's (see J5] Part VI]; 11221 ). and are ready to be directly adopted in reachability 
analysis of MCs. However, we don't have the corresponding algorithms for qMCs in 
hands and have to start from scratch. So, in order to conduct reachability analysis for 
qMCs we introduce the notion of BSCC and develop an algorithm for finding BSCC de- 
composition for qMCs in this paper. Interestingly, there are some essential differences 
between BSCCs in the classical and quantum cases. For example, BSCC decomposi- 
tion of a qMC is unnecessary to be unique. Also, classical algorithms for finding BSCCs 
like depth-first search cannot be directly generalised to qMCs. Instead, it requires very 
different ideas to develop algorithms for finding BSCCS of qMCs, appealing to matrix 
operation algorithms [,5, Chapter 28] through matrix representation of super-operators. 
The major challenge in dealing with quantum BSCCs, which would not arise in clas- 
sical BSCCs at all, is to maintain the linear algebraic structure underpinning quantum 
systems. We believe that these results for quantum BSCCs obtained in this paper are 
also of independent significance. 

This paper is organised as follows. The preliminaries are presented in Sec. in 
particular we recall the notion of qMC and define the graph structure of a qMC. The 
notion of BSCC of a qMC is introduced in Sec. [3j where a characterisation of quantum 
BSCC is given in terms of the fixed points of super-operators, and an algorithm for 
checking whether a subspace of the state Hilbert space of a QMC is BSCC is given. 
In Sec. H] we define the notion of transient subspace of a qMC and show that the state 
space of a qMC can be decomposed into the direct sum of a transient subspace and 
a family of BSCCs. Furthermore, it is proved that although such a decomposition is 
not unique, the dimensions of its components are fixed. In particular, an algorithm for 
constructing BSCC decomposition of qMCs is found. With the preparation in Sees. [3] 
and|H we examine reachability of a qMC in Sec. [5] where an algorithm for computing 
reachability probability is presented. An algorithm for computing repeated reachability 
and persistence probabilities is finally developed in Sec. [6] Sec.|7]is a brief conclusion. 

2 Quantum Markov Chains and Their Graph Structures 

2.1 Basics of Quantum Theory 

For convenience of the reader, we recall some basic notions from quantum theory; for 
details we refer to |fl7l . The state space of a quantum system is a Hilbert space. In this 
paper, we only consider a finite-dimensional Hilbert space H, which is just a finite- 
dimensional complex vector space with inner product. The inner product of two vectors 
\<fi),\4i) £ H is denoted by (<j)\ip). A pure quantum state is a normalised vector \<j>) in % 
with (4>\4>) = 1. We say that two vectors \<p) and \tp) are orthogonal, written \cf>) -L\tjj) , 



if (4>\if.') = 0. A mixed state is represented by a density operator, i.e. a positive operator 
p on H with tr(p) = 1, or equivalently a positive semi-definite and trace-one n x n 
matrix if dimH = n. In particular, for each pure state \tp), there is a corresponding 
density operator t/j = \ip)(ip\. For simplicity, we often use pure state \ip) and density 
operator tp interchangeably. A positive operator p is called a partial density operator if 
trace tr(p) < 1. The set of partial density operators on H is denoted by V(H). The 
support supp(p) of a partial density operator p G T>{H) is defined to be the space 
spanned by the eigenvectors of p with non-zero eigenvalues. The set of all (bounded) 
operators on H, i.e. d x d complex matrices with d = dim('H), is denoted by B(H). 

For any set V of vectors in H, we write spanT^ for the subspace of H spanned by 
V; that is, it consists of all finite linear combinations of vectors in V. Two subspaces X 
and Y of H are said to be orthogonal, written X1.Y, if I^J-lf/;) for any \<fi) € X and 
IV-") G Y. The ortho-complement X 1 - of a subspace X of H is the subspace of vectors 
orthogonal to all vectors in X. An operator P is called the projection onto a subspace 
X if P|V>) = \ip) for all WgI and P|V>) = for all \i/;) € X ± .We write F x for the 
projection onto X. According to the theory of quantum measurements, for any density 
operator p, trace tr(Pxp) is the probability that the mixed state p lies in subspace X. 
Let {Xk] be a family of subspaces of H. Then the join of {X^} is defined by 

\/X k = apan([jX k ). 

k k 

In particular, we write X V Y for the join of two subspaces X and Y, It is easy to see 
that \/ . Xk is the smallest subspace of H that contains all Xk- 

Composed quantum systems are modelled by tensor products. If a quantum system 
consists of two subsystems with state spaces Hi and H2, then its state space is H. = 
T-L\ <8> H2, which is the Hilbert space spanned by vectors \tpi) \ip2) = |"0i) ® l"02) with 
\tpi) G Hi and \tjj2) € %2- For any operators A\ on Hi and A2 on H2, their tensor 
product A\ ® A2 is defined by 

(Ai ® A 2 )(|Vi)|V2» = (Axl^x)) ig) (A 2 |^2» 

for all l^i) G 'Hi and |-02) G ^2 together with linearity. 

The evolution of a closed quantum system is described as a unitary operator, i.e. 
an operator U on H with WlJ = UU^ = I, where I is the identity on H. A pure 
state \<f>) becomes U\<j>) after this unitary evolution U, while a mixed state p becomes 
UpU^. The dynamics of an open quantum system is described by a super-operator, i.e. a 
linear map £ from the space of linear operators on H into itself, satisfying the following 
conditions: 

1. tr[£(p)} < ti(p) for all p G T>{H), with equality for trace-preserving £\ 

2. Complete positivity: for any extra Hilbert space Hr, (Tr (8) £)(A) is positive pro- 
vided A is a positive operator on Hr <£> H, where Xr is the identity map on the 
space of linear operators on Hr. 

In this paper, we only consider trace-preserving super-operators. Each super-operator 
has a Kraus operator-sum representation: £ = J^ Ei ■ Ej, or more precisely 



£( P )=Y J E i pEt 



for all p £ T>(H), where Ei are operators on H such that J^. E^Ei = I. 

2.2 Quantum Markov Chains 

Now we are ready to introduce the notion of quantum Markov chain. Recall that a 
Markov chain is a pair (S, P), where S is a finite set of states, and P is a matrix of 
transition probabilities, i.e. a mapping P : S x S — > [0, 1] such that 

tes 

for every s £ S, where P(s,t) is the probability of going from s to t. A quantum 
Markov chain is a quantum generalisation of a Markov chain where the state space of 
a Markov chain is replaced by a Hilbert space and its transition matrix is replaced by a 
super-operator. 

Definition 1. A quantum Markov chain is a pair Q = (%,£), where H. is a finite- 
dimensional Hilbert space, and £ is a super-operator on %. 

The behaviour of a quantum Markov chain can be described as follows: if currently 
the process is in a mixed state p, then it will be in state £(p) in the next step. Both p and 
£{p) can be written as statistical ensembles: 

P = ^2Pi\<l>i){<f>i\, £{p) =^2<lj\^j){^j\, 

i 3 

where pi, qj > for all i,j, and J^ Pi = J2j Qj = •"•■ So, super-operator £ can be un- 
derstood as an operation that transfers statistical ensemble {(pi, \4>i})} to {(qj, IV'j))}- 
In this way, a quantum Markov chain can be seen as a generalisation of a Markov chain. 

2.3 Graphs in Quantum Markov Chains 

There is a natural graph structure underlying a quantum Markov chain. This can be 
seen clearly by introducing adjacency relation in it. To this end, we first introduce an 
auxiliary notion. The image of a subspace XofH under a super-operator £ is defined 
to be 

£{X)= \/ supp(£(V0). 

Intuitively, £(X) is the subspace of H spanned by the images under £ of states in X. 

Definition 2. Let Q = (%,£) be a quantum Markov chain, and let \tp) and |"0) be pure 
states and p and a mixed states in %. Then 

1. \ip) is adjacent to \ip) in Q, written \ip) -> \(p), if \ip) £ £(X^), where X^, = 
span{|V')}. 

2. \<p) is adjacent to p, written p —t \ip), if\(f) £ £(supp(p)). 

3. a is adjacent to p, written p — > a, // , supp(<r) C £ (supp(p)). 



Definition 3. 1. A sequence tt = po — > pi —>•••• — > p„ of adjacent density operators 
in a quantum Markov chain Q is called a path from p$ to p n in Q, and its length is 
\n\ = n. 
2. For any density operators p and a, if there is a path from p to a then we say that er 
is reachable from p in Q. 

Definition 4. Let Q = {%,£) be a quantum Markov chain. For any p G D(7-L), its 
reachable space in Q is 

IZg(p) = span{|V>) G H ■ \ip) is reachable from p in Q}. 

The following lemma are very useful for our latter discussion. 

Lemma 1. 1. (Transitivity of reachability) For any p, a G T){'H), ifswpp(p) C IZg(a), 

then IZg(p) Q TZg(a). 
2. H24\ Theorem 1] If d = dimTL, then for any p G D(TL), we have 

d-l 

Kg{p) = V supp(^(p)). (1) 

i=0 

3 Bottom Strongly Connected Components 

3.1 Basic Definitions 

The notion of bottom strongly connected component plays an important role in model 
checking Markov chains. In this section, we extend this notion to the quantum case. We 
first introduce an auxiliary notation. Let X be a subspace of a Hilbert space, and let £ 
be a super-operator on H. Then the restriction of £ on X is defined to be super-operator 
£ \x with 

£\ x {p) = Px£( P )Px 

for all p G T>{X), where P\ is the projection onto X. 

Definition5. Let Q = {%,£) be a quantum Markov chain. A subspace X of % is 
called strongly connected in Q if for any \(p), \ip) G X, we have \tp) G 1Zg x (i})) and 
\ip) G TZ-gx (v), where quantum Markov chain Qx = (X, £x) is the restriction ofQ on 
X. 

We write SC(Q) for the set of strongly connected subspaces of H in Q . It is easy to 
see that (SC(G), C) is an inductive set; that is, for any subset {X{\ of SC(Q) that is 
linearly ordered by C, we have [J i Xi G SC(G). Thus, by Zorn lemma we assert that 
there exists a maximal element in SC(Q). 

Definition 6. A maximal element of (SC{Q) , C ) is called a strongly connected compo- 
nent (SCC) ofQ. 

To define bottom strongly connected component, we need an auxiliary notion of 
invariant subspace. 



Definition 7. Let Q = ("H, £) be a quantum Markov chain. Then a subspace X ofH is 
said to be invariant in Q if £(X) C X. 

It is easy to see that if super-operator £ has the Kraus representation £ = J2 i E,-EJ, 
then X is invariant if and only if EiX C X for all i. Recall that in a classical Markov 
chain, the probability of staying in an invariant subset is non-decreasing. A quantum 
generalisation of this fact is presented in the following: 

Theorem 1. For any invariant subspace XofH in a quantum Markov chain Q = 
(H,£), we have 

tr{P x £{p)) > tr(P x p) 

for all p € T>{Ji\ where Px is the projection onto X. 

Now we are ready to introduce the key notion of this section. 

Definition 8. Let Q = {%,£) be a quantum Markov chain. Then a subspace XofH 
is called a bottom strongly connected component (BSCC) of Q if it is a SCC of Q and 
invariant in Q. 

Example 1. Consider quantum Markov chain Q = (rl,£) with state space H = span{|0), 
• ■ • , 1 4)} and super-operator 
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£ = Y,Ei-El 
i=l 

where the operators E,i (i=l,...,5) are given as follows: 

E x = -i=(|l)<0 + 1| + |3>(2 + 3|), E 2 = ^(|1>(0 - 1| + |3)(2 - 3|), 
E 3 = 4(|0)(0 + 1| + |2)(2 + 3|), E 4 = -^(|0)(0 - 1| + |2)(2 - 3|), 
E 5 = ^(|0)(4| + |1)<4| + |2)(4| +4|3)(4| +9|4)(4|), 

and the states used above are defined by 

|0 ± 1) = (|0) ± |l))/\/2 and |2 ± 3) = (|2) ± |3))/v^. 

It is easy to see that B = span{|0), |1)} is a BSCC of quantum Markov chain Q, as for 

any \ip) = a\0) + /3|1) G B, we have S(i>) = (|0)(0| + |l)(l|)/2. 

The following lemma clarifies the relationship between different BSCCs. 

Lemma 2. 1. For any two different BSCCs X and Y of quantum Markov chain Q, we 
have X n Y — {0} (0- dimensional Hilbert space). 
2. If X and Y are two BSCCs ofQ with dim X ^ dim Y , then XJJY. 



3.2 Characterisations of BSCCs 

This subsection purports to give two characterisations of BSCCs. The first is presented 
in terms of reachable space. 

Lemma 3. A subspace X is a BSCC of quantum Markov chain Q if and only ifHg(<fi) = 
X for any non- zero \<j>) G X. 

To present the second characterisation, we need the notion of fixed point of super- 
operator. 

Definition 9. 1. A nonzero partial density operator p G T>{T~C) is called a fixed point 
state of super-operator £ if£{p) = p. 
2. A fixed point state p of super-operator £ is called minimal if for any fixed point 
state a of £, it holds that supp(a) C supp(p) implies a = p. 

The second characterisation of BSCCs establishes a connection between BSCCs 
and minimal fixed point states. 

Theorem 2. A subspace X is a BSCC of quantum Markov chain Q = ('H,£} if and only 
if there exists a minimal fixed point state p of £ such that supp(p) = X. Furthermore, 
p is actually the unique fixed point state, up to normalisation, with the support included 
in X. 



3.3 Checking BSCCs 

We now present an algorithm that decides whether or not a given subspace is a BSCC 
of a quantum Markov chain (see Algorithm [TJi. The correctness and complexity of this 
algorithm are given in the following theorem. 

Theorem 3. Give a quantum graph {H,£} and a subspace X C %, Algorithm\l\de- 
cides whether or not X is a BSCC ofQ in time 0(n e ), where n = dim('H). 



4 Decomposition of the State Space 

A state in a classical Markov chain is transient if there is a non-zero probability that the 
process will never return to it, and a state is recurrent if from it the returning probability 
is 1. It is well-known that a state is recurrent if and only if it belongs to some BSCC in 
a finite-state Markov chain, and thus the state space of a classical Markov chain can be 
decomposed into the union of some BSCCs and a transient subspace |2), lfl6l . The aim 
of this section is to prove a quantum generalisation of this result. 

Definition 10. A subspace X C.H is transient in a quantum Markov chain Q = (H, £) 

if 

lim tr (P x £ k (pj) = 

k—too 

for any p G T>(7{), where Px is the projection onto X. 



Algorithm 1: CheckBSCC(X) 



input : A quantum Markov chain Q = {H, £) and a subspace X C H 

output: True or False indicating whether X is a BSCC of Q 

begin 

if£(X) gXthen 

return False; 
end 

£' <- P x o £; 

B <r- a density operator basis of the set {A £ B{H) : £'(A) = ^4}; (*) 

if \B\ > lthen 

return False; 
else 

p <— the unique element in B; 
if X = supp(p) then 

return True; 
else 

return False; 
end 
end 
end 



The above definition is stated in a "double negation" way. Intuitively, it means that 
the probability in a transient subspace will be eventually zero. To understand this defi- 
nition better, let us recall that in a classical Markov chain, a state s is said to be transient 
if the system starting from s will eventually return to s with probability less than 1 . It is 
well-known that in a finite-state Markov chain, this is equivalent to that the probability 
at this state will eventually become 0. In the quantum case, the property "eventually 
return" can be hardly described without measurements, and measurements will disturb 
the behaviours of the systems. So, we choose to adopt the above definition. 

To give a characterisation of transient subspace, we need the notion of the asymp- 
totic average of a super-operator £, which is defined to be 

i N 

AT-s-oo TV L — ' 
n—\ 

It is easy to see from 12T1 Proposition 6.3, Proposition 6.9] that E^ is a super-operator 
as well. 

Theorem 4. The ortho-complement of the image of the state space H of a quantum 
Markov chain Q = {%,£) under the asymptotic average of super-operator £: 

T £ := SocCH^ 

is the largest transient subspace in Q; that is, any transient subspace ofQ is a subspace 
ofT s . 



We now turn to examine the structure of the image of the state space H under super- 
operator £. 

Theorem 5. Let Q = {%,£) be a quantum Markov chain. Then £oo {%) can be decom- 
posed into the direct sum of some orthogonal BSCCs ofQ. 

Combining Theorems [4] and [5] we see that the state space of a quantum Markov 
chain Q = (H,£) can be decomposed into the direct sum of a transient subspace of a 
family of BSCCs: 

U = B 1 ®---®B U ®T £ (3) 

where B, 's are orthogonal BSCCs of Q. A similar decomposition was recently obtained 
in lfl8ll for a special case of £ 2 = £. The above decomposition holds for any super- 
operator £ and thus considerably generalises the corresponding result in [ 18'.]. 

The BSCC and transient subspace decomposition of a classical Markov chain is 
unique. However, it is not the case for quantum Markov chains; a trivial example is that 
£ is the identity operator, for which any 1 -dimensional subspace of "H is a BSCC, and 
thus for each othonormal basis {\i}} of W, (J), span{|i)} is an orthogonal decomposi- 
tion of H. The following is a more interesting example. 

Example 2. Let quantum Markov chain Q = (£, H) be given as in Example Q] Then 
B x = s P an{|0), |1)}, B 2 = span{|2), |3)}, D l = span{|0 + 2), |1 + 3)}, and D 2 = 
span{|0 — 2), |1 — 3)} are BSCCs, and T £ = span{|4)} is a transient subspace. Fur- 
thermore, we have 

H = B 1 ®B 2 ®T £ = D 1 ®D 2 ® T £ . 

The relation between different decompositions of a quantum Markov chain is clari- 
fied by the following. 

Theorem 6. Let Q = {%,£) be a quantum Markov chain, and let 

n = B 1 @---@B u @T £ =D l @---@D v @T £ 

be two decompositions in the form of Eq. (0, and BiS and DiS are arranged, re- 
spectively, according to the increasing order of the dimensions. Then u = v, and 
dim(i?i) = dim(Di) for each 1 < i < u. 

To conclude this section, we present an algorithm for finding a BSCC and transient 
subspace decomposition of a quantum Markov chain (see Algorithmic. 

Theorem 7. Give a quantum graph {%, £), Algorithm\2\decomposes the Hilbert space 
% into the direct sum of a family of orthogonal BSCCs and a transient subspace ofQ in 
time 0(n s ), where n = dim('H). 

5 Reachability Probability 

The traditional way to define reachability probabilities in classical Markov chains is first 
introducing a probability measure based on cylinder sets of finite paths of states. The 



Algorithm 2: Decompose^) 



input : A quantum Markov chain Q — (H,£) 

output: A set of orthogonal BSCCs {Bi} and a transient subspace Tg such that 

U = 0, Bi T £ 
begin 

B <— Decompose(£ 00 ('H)); 
returns, f 00 ('H) ± ; 
end 



probability of reaching a set T is then the probability measure of the set of paths which 
include a state from T. Typically, reachability probabilities can be obtained by solving a 
system of linear equations, which is easy and numerically efficient. In quantum Markov 
chains, however, it is even not clear how to define such a probability measure. Thus it 
seems hopeless to extend reachability analysis to the quantum case in this way. 

Fortunately, there is another way to compute the reachability probability in a clas- 
sical Markov chain (S, P). Given a set of states T C S, we first change the original 
Markov chain into a new one (S, P') by making states in T absorbing. Then the reach- 
ability probability of T is simply the limit of the probability accumulated in T, when 
the time goes to infinity. It turns out that this equivalent definition can be extended into 
the quantum case as follows. 

Definition 11. Let {%, £) be a quantum Markov chain, p £ T>(H) an initial state, and 
G CMfl subspace. Then the probability of reaching G, starting from p, can be defined 
as 

Pr(pN0G)= lim \,y(P g £\p)) 

i— »oo 

where £ — Pq + £ o (/ — P G ) is the super-operator which first performs the projective 
measurement {Pg, I — Pg\ an d then applies the identity operator I or £ depending 
on the measurement outcome. 

Obviously the limit in the above definition exists, as the probabilities tY(Pa£ l (p)) are 
nondecreasing in i. 

To compute the reachability probability, we first note the subspace G is invari- 
ant under £ . Thus (G,£) is again a quantum Markov chain. Since £{Iq) = Ig an d 
£oo(G) = G, we can decompose G into a set of orthogonal BSCCs according to £ by 
Theorem[5] The following lemma shows a connection between the limit probability of 
hitting a BSCC and the probability that the asymptotic average of the initial state lies in 
the same BSCC. 

Lemma 4. Let {Bi} be a BSCC decomposition of£ CX} {%), and PB t the projection onto 
B^ Then for each i, we have 

lim tr(P Bi £ k (p)) = ixiPuMp)) (4) 

k— >oo 



for all p e V(H). 



Procedure Decompose(X) 



input : A subspace X which is the support of a fixed point state of £ 
output: A set of orthogonal BSCCs {B,} such that X = ®Bi 
begin 

£' <- Pa- o £ ; 

5 <- a density operator basis of the set {A £ B(H) : £'(A) = A}; 

if \B\ = 1 then 

p <— the unique element of B; 
return {supp(p)}; 
else 

pi, pi <— two arbitrary elements of B; 
p <— positive part of p\ — pi\ 

Y <— supp(p) ± ; (* the ortho-complement of supp(p) in X*) 

return Decompose(supp(p)) U Decompose(y); 
end 
end 



Lemma [4] and Theorem [4] together give us an efficient way to compute the reacha- 
bility probability from a quantum state to a subspace. 

Theorem 8. Let (H,£) be a quantum Markov chain, p S T>(^-i\ and G C % a sub- 
space. Then 

Pv(p\=0G) = tT(P G S oo (p)), 

and this probability can be computed in time 0(n s ) where n = dim('H). 

Our next results assert that if a quantum Markov chain starts from a pure state in a 
BSCC then its evolution sequence ip, £(ip), £ 2 (ip), ■ ■ • will hit a subspace with non-zero 
probability infinitely often provided X is not orthogonal to that BSCC. They establishes 
indeed a certain fairness and thus can be seen as quantum generalisations of Theorems 
10.25 and 10.27 in J2). It is well-known that in the quantum world a measurement will 
change the state of the measured system. Consequently, fairness naturally splits into 
two different versions in quantum Markov chains. 

Lemma 5. (Measure-once fairness) Let B be a BSCC of quantum Markov chain Q = 
(%, £), and X a subspace which is not orthogonal to B. Then for any \ip) £ B, it holds 
that ti{Px£ l {ip)) > for infinitely many i. 

Lemma 6. (Measure-many fairness) Let B be a BSCC of a quantum Markov chain 
Q = (H,£), and X C B a subspace of B. Then for any \ip) G B, we have 

lim tr(,T(V>)) = 0, 

i— >oo 

where £ = Px^ ° £> an d X is the ortho-complement of X in H. 

Lemma [6] was stated also in a "double negation" way. To best understand it, let 
us assume that at each step after £ is applied, we perform a projective measurement 



{Px, Px-l}- If the outcome corresponding to P\ is observed, the process terminates 
immediately; otherwise, it continues with another round of applying £. Lemma[6]asserts 
that the probability of nontermination is asymptotically 0; in other words, if we set X as 
an absorbing boundary, which is included in BSCC B, the reachability probability will 
be absorbed eventually. This lemma is indeed a strong version of fairness. Furthermore, 
we have: 

Theorem 9. Let Q = (H, £) be a quantum Markov chain, and let X be a subspace of 
%, and £ — Px-l ° £. Then the following two statements are equivalent: 

1. The subspace X 1 - contains no BSCC; 

2. For any p G T)(H), we have 

lim tr(£*(p)) = 0. 

i— >oo 

It is worthy noting that in Theorem|9] X is not required to be a subspace of a BSCC 
B. The following two examples give some simple applications of Theorem|9] 

Example 3. Consider a quantum walk on an n-size cycle JQ. The state space of the 
whole system is H = H p <8> H c , where W p = span{|0), • • • , \n — 1)} is the position 
space, and H c = span{|0), |1)} is the coin space. The evolution of the systems is 
described by a unitary transformation U = S(I <E) H), where the coin operator H is the 
Hadamard operator, and the shift operator 

n-l 
j=0 

where the arithmetic operations over the index set are understood as modulo n. If we 
set absorbing boundaries at position 0, then from any initial state \ip), we know from 
Theorem [9] that the probability of nontermination is asymptotically because there is 
no BSCC which is orthogonal to the absorbing boundaries. 

Example 4. Consider the quantum Markov chain in Example Q] Let po be the initial 
state, and assume that projective measurement {Pq = |0)(0|,Pi = I — Pq} will be 
per formed at the end of each step and Pq is set as the absorbing boundary. We write 
pk = £ k (po) for the partial density operator after k steps, where £ = Pi o £. 

1 . If po = 1 1) (1|> then limfc-^oo pk = 0. This means the probability will be eventually 
absorbed. 

2. Ifpo = |2)(2|,thenlim fc ^ 0O p fe = (|2)(2| + |3)(3|)/2. No probability is absorbed. 
Let D\ and £>2 be as in Example[2] Then the probabilities in D\ and D^ are both 
0.5. This means that if supp(Po) is not orthogonal to a BSCC D, then the proba- 
bility in D may not be absorbed. 

6 Repeated Reachability and Persistence Probabilities 

In this section, we consider how to compute two kinds of reachability probabilities, 
namely "repeated reachability" and "persistence property", in a quantum Markov chain. 
Note that £00 (H)' L is a transient subspace. We can focus our attention on £00 (H). 



Definition 12. Let Q = {%,£) be a quantum Markov chain and G a subspace of 

£oo{H). 

1. The set of states in £ a o{'ri) satisfying the repeated reachability "infinitely often 
reaching G" is 

X{G) = {|V) e SaoCH) : Km tv((P G ± ° £ ) k (i/>)) = 0}. 

fc— >oo 

2. The set of states in £oo(%) satisfying the persistence property "eventually always 
in X " is 

y(G) = {|V) e 800(H) : (3N > 0)(Vfc > TV) supp(f fe (^)) C G}. 

The set X{G) is defined again in a "double negation" way. Its intuitive meaning 
can be understood as follows: if the process starts in a state in X{G) and we make G 
absorbing, then the probability will be eventually absorbed by G. 

The following theorem gives a characterisation of X(G) and y(G) and also clarifies 
the relationship between them. 

Theorem 10. For any subspace G o/'£ 00 ('H), both X(G) and y(G) are subspaces of 
%. Furthermore, we have 

X{G) = £ 00 {G), y(G)= \/ B = X(G ± ) ± , 

BCG 

where B ranges over all BSCCs, and the orthogonal complements are taken in £ 00 {'rl). 
Moreover, both X(G) andy(G) are invariant. 

Example 5. Let us revisit Example Q] where SooiJ-L) = span{|0), |1), |2), |3)}. 

1. If G = span{|0), |1), |2», then S^G^ = su PP (f 0O (|3)(3|)) = supp((|2)(2| + 
|3)(3|)/2) and S^G) = £«,(%). Thus y(G) = B x and X(G) - £«,(«). 

2. IfG = span{|3)},thenf 00 (G- L ) = B 1 ®B 2 a.nd£ ao {G) = B 2 . Thus y(G) ={0} 
andA"(G) = B 2 . 

Now we can define probabilistic persistence and probabilistic repeated reachability. 



Definition 13. 1. The probability that a state p satisfies the repeated reachability 
rep(G) is the eventual probability in X(G), starting from p: 

Pr(p N rep(G)) = lim t?{P x(G) £ k (p))- 

2. The probability that a state p satisfies the persistence property pers(G) is the even- 
tual probability in y(G), starting from p: 

PT(p\=pers(G)) = lim tv(P y(G) £ k (p)). 



The well-definedness of the above definition comes from the fact that X(G) and 
y(G) are invariant. By TheoremUJwe know that the two sequences {tr(Pxtc)£ k (p))} 
and {tr(Py(Q)£ k (p))} are non-decreasing, and thus their limits exist. Combining The- 
orems |4] and [TO] we have: 

Theorem 11. 1. The repeated reachability probability is 

Vx{p N rep(G)) = 1 - tr(P x(GV £oo{p)) = 1 - Pr(p N per^G" 1 )). 

2. r/je persistence probability is 

Yi{p^pers{G)) = tv(Py {G )£oo(p)). 

Finally, we are able to give an algorithm for computing reachability and persistence 
probabilities (see Algorithm |3). 

Algorithm 3: Persistence(G, p) 
input : A quantum Markov chain (H, £}, a subspace GC?i, and an initial state 

p e V(H) 

output: The probability Pr(p t= pers(G)) 
begin 

Poo <— £ao(p); 
y^£: oo (G ± ); 

P <— the projection onto Y ; (* F is the ortho-complement of K in £ o('H) *) 
return tr(Pp cx) ); 
end 



Theorem 12. G/ve a quantum Markov chain (rl,£), an initial state p S T>(H), and a 
subspace G Q TL, Algorithm\3\computes persistence probability Pr(p 1= pers(G)) in 
time 0(n s ), where n = dim('H). 

With Theorem [TT] Algorithm [3] can also be used to compute repeated reachability 
probability Pr(p N rep(G)). 



7 Conclusions 

We introduced the notion of bottom strongly connected component (BSCC) of a quan- 
tum Markov chain (qMC) and studied the BSCC decomposition of qMCs. This enables 
us to develop an efficient algorithm for computing repeated reachability and persistence 
probabilities of qMCs. Such an algorithm may be used to verify safety and liveness 
properties of physical systems produced in quantum engineering and quantum programs 
for future quantum computers. 
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A Proofs of Lemmas and Theorems 

We first collect some simple properties of the support of super-operators for our latter 
use. 

Proposition 1. 1. If A — Y k ^k\<t>k){4>k\ where all A& > (but \<j>k)'s are not re- 
quired to be pairwise orthogonal), then supp(A) = span{|0fc)}; 

2. supp(£(p + a)) = supp(£(p)) V supp(£(<r)); 

3. IfS = J2 ie i E i ■ E t> then £ ( X ) = spm{Ei\i/)) : * G I, \i<) e X}; 

4. £{X 1 V X 2 ) = £{X X ) V £{X 2 ). Thus, X C Y => £{X) C £(Y). 

Let £ = Y^i Ei ■ E] be a super-operator on an n-dimensional Hilbert space H. The 
matrix representation M of £ is an n 2 x n 2 matrix M — J^\ Ei g> E* 1251211 . Let 
M = SJS -1 be the Jordan decomposition of M where 

K 



J = (&J k (Xk), 



k=l 



and Jk (Afc) is a Jordan block corresponding to the eigenvalue A&. Define 

Jco= Jk(\k) 
fc:A fc = l 

and Mqo = SJ 00 S~ 1 . Then from lETl Proposition 6.3], we know that M^ is exactly 
the matrix representation of £ ao . 

Lemma 7. Let (TL, £) be a quantum Markov chain with dim(H) = n, and p 6 T)(T-L). 

1. The asymptotic average of p under £, i.e. £oo(p), can be computed in time 0(n 8 ). 

2. A density operator basis of the set {A 6 B(H) : £{A) = ^4} can be computed in 
time 0(n 6 ). 

Proof. 1. Note that the time complexity of Jordan decomposition is 0(d A ) for adx d 
matrix. We can compute M^, the matrix representation of £oo, in time 0(n 8 ). 
Then £oo (a) can be easily derived from the correspondence 

(£<» (p) ®In)\*) = Moc {p®Iu)W) 

where \\P) = 2~27=i l*)N) * s trie (unnormalised) maximally entangled state in H<£)W. 
2. We compute the density operator basis by the following three steps: 

(i) Compute the matrix representation M of £. The time complexity is 0(mn 4 ), 

where m < n 2 is the number of Ei's in £ = 2~2i Ei ■ Ej. 
(ii) Find a basis B for the null space of the matrix M — Iu^u, an d transform them 
into matrix forms. This can be done by Guassian elimination with complexity 
being 0((n 2 ) 3 ) = 0{n 6 ). 



(iii) For each basis matrix A in B, compute positive matrices X + , X- , Y + , F_ such 
that supp(X + ) _L supp(X_), supp(l+) _L supp(YL), and A = X + — X- + 
i(Y + —YJ). Let Qbe the set of nonzero elements in {X + ,X-, Y + , Y—}. Then 
by l2Tl Proposition 6.8], every element of Q is a fixed point state off. Replace 
A by elements of Q after normalisation. Then the resultant B is the required 
density operator basis. At last, we make the elements in B linearly independent. 
This can be done by removing elements in B using Guassian elimination. The 
computational complexity of this step is 0(n 6 ). 

With these steps, we know the total complexity is 0(n 6 ). □ 

Proof of LemmaU] We only prove part 1; for the proof of part 2, see 11241 . It follows 

from 

00 

supp(p) C TZg(a) = \/ supp(£ n (a)) 
that 

OO OO OO 

KoQ>) = V £ m ( su PP(p)) c V/ f ™( V supp(£»)) 

m— m— n— 

00 

= \fsupp(£ i (a))=1lQ(a). 

n 

Proof of Theorem\T\ Let X" 1 be the ortho-complement of X and Q the projection onto 
X- 1 -. Then P x +Q = I- Let £* = £\ £?| ■ E % be the Schrodinger-Heisenberg dual of 
£. Since X is invariant under £, we have (ip\Ei\<fi) = for any |</>) e X, |?/») G X 1 - 
and for any i. Thus £*{Q) is in X x . Furthermore, it holds that £*{Q) < £*{I) = I. 
This implies £*{Q) < Q. Finally, we have 

tr(P x £(p))=tr(£*(P x )p) 

= tv{£*(I)p) - tr(£* (Q)p) > tr(p) - tr(Qp) = tr(Pjfp). 

D 

Proof of Lemma \3\ We only prove the necessity part; the sufficiency part is obvious. 
Suppose X is a BSCC. By the strong connectivity of X, we have 7Zg(ip) 2 X for all 
\ip) E X. On the other hand, we have from the invariance of X that £(X) C X. Thus 
Hg(<f>) = X for any non-zero vector \<j>) in X. □ 

Proof of Lemma\2\ Part 1: Suppose conversely that there exists a nonzero vector |^>) G 
Af) B. Then by Lemma [3] we have A = lZg((f>) = B, contradicting the assumption 
that A ^ B. Therefore AnB = {0}. 

Part 2: We postpone this part after the proof of Theorem [5] □ 

Before proving Theorem[2] we recall some basic properties of fixed point states. For 
more details, we refer to 01211 . 



Lemma 8. ( K21\ Proposition 6.3, Proposition 6.9]) If £ is a sper-operator on %, then 

1. for any density operator p, £oo{p) is a fixed point state of £; 

2. for any fixed point state a, it holds that supp(cr) C £ 00 {'H). 

An operator (not necessarily a partial density operator) A g B(H) is called a fixed 
point of super-operator £ if £(A) = A 

Lemma 9. Let £ be a super-operator on %. Then 

1. ( I\21\ Proposition 6.8]) If A is a fixed point of '£, and 

A=(X + -X_) +l (Y + -Y_) 

where X + , X—, Y + , Y^ are positive operators with supp(AT + )_l_supp(X_) and 
supp(y + )_Lsupp(Y_), then X + , X—, Y + , Y- are all fixed points of '£. 

2. (fi3\ Lemma 2]) If p is a fixed point state for £, then supp(p) is an invariant sub- 
space. Conversely, if X is an invariant subspace of '£, then there exists a fixed point 
state px such that supp(px) C X. 

Proof of Theorem\2\ We first prove the sufficiency part. Let p be a minimal fixed point 
state such that supp(p) = X. Then by Lemma[9]2, X is an invariant subspace. To show 
that X is a BSCC, by Lemma[3]it suffices to prove for any \<f>) <G X, lZg(<f>) = X. 
Suppose conversely there exists \if>) £ X such that TZg(ip) C X. Then by LemmaQ] 
lZg(t/j) is an invariant subspace of £ as well. By Lemma[9]2, we can find a fixed point 
state pij) with supp(p^) C 1Zg(ip) C X, contradicting the assumption that p is minimal. 

For the necessity part, let X be a BSCC. Then X is invariant, and by Lemma|9]2, 
we can find a minimal fixed point state px with supp(px) C X. Take |</>) E supp(p^)- 
By Lemma|2]we have lZg((f>) = X. But on the other hand, by Lemma|9]2 again we 
have supp(pjf) is invariant, so !Zg(<f>) C supp(px)- Thus supp(px) = X indeed. 

Finally, the uniqueness of p comes from the observation that whenever p and a are 
both fixed point states of £, then so are \p + -fa, provided that it is nonzero, for any 
real numbers A and 7. □ 

Proof of Theorem\3\ By Theorem [2] to check whether a subspace X is a BSCC, it is 
sufficient to check the following two properties: 

1 . X is invariant; 

2. Every fixed point state of £\ x has X as its support. 

That justifies the correctness of Algorithm Q] The complexity of this algorithm mainly 
comes from the statement (*) which, according to Lemma|7]2, can be computed in time 
0(n 6 ). D 

Proof of Theorem^ Let P be the projection onto Tg, p G T>{H), andpfc = tr(P£ k (p)). 
Since £ 00 ('H) is an invariant subspace, by Theorem Q] we have pk is nonincreasing. 



Thus the limit p^ = ]im.k^oo Pk does exist. Furthermore, noting that supp(£oo(p)) C 
£<x>(rl), we have 

= tiiPSM) = tr ^M 1 Er^j 

iV JV 

lim — Vtr(Pf n (p))= lim -Vp n 

1 * 



JV->-oo A^ ^-— ' JV-s-oo AT 

n— 1 n— 1 



> lim 

AT-foo AT 

Thus p^ = 0, and Tg is transient by the arbitrariness of p. 

To show that Tg is the largest transient subspace of Q, note that supp(£ 00 (/)) = 
£ooOH)- Let a = £oo(I/d). Then by Lemma[8] a is a fixed point state with supp(er) = 
Tg~. Suppose Y is a transient subspace. We have 

lim tr(P y r(cr)) = tr(Pycr) = 0. 

This implies Y _L supp(cr) = T/. That is Y C T f . D 

Lemma 10. Let p and a be two fixed point state of £, and supp(er) C supp(p). Then 
there exists another fixed point state rj with supp(?7)_Lsupp(cr) such that 

supp(p) = supp(7?) © supp(a). 

Proof. Note that for any A > 0, p — Aer is again a fixed point of £. We can take A 
sufficiently large such that p — \a = A + — A- with A± > 0, supp(Z\_) = supp(a), 
andsupp(Zl + ) is the orthogonal complement of supp(Z\_) insupp(p). By Lemma[9]l, 
both A + and Z\_ are again fixed point states of £. Let r) = A + . We have 

supp(p) = supp(p — Act) = supp(zi + ) © supp(Z\_) = supp(7y) © supp(er). 

D 

The following corollary is immediately from Lemma [TOl 

Corollary 1. Let p be a fixed point state of £. Then supp(p) can be decomposed into 
the direct sum of some orthogonal BSCCs. 

Proof. If p is minimal, then by Theorem|2] supp(p) is itself a BSCC and we are done. 
Otherwise, we apply Lemma [10] to obtain two fixed point states of £ with smaller or- 
thogonal supports. Repeating this procedure, we will get a set of minimal fixed point 
states p\ , ■ ■ ■ ,pk with mutually orthogonal supports, and 

k 
supp(p) = (J)supp(pj). 

Finally, from Lemma|9]2 and Theorem[2] each supp(pi) is a BSCC. □ 



Proof of Theorem\5\ Direct from Corollary Q~|by noting that £00 (-0 is a fixed point state 
of £ with supp {£ oo (I))=£ OQ (H). □ 

Proof of Lemma\2\2. Suppose without loss of generality that dim(Bi) < dim(i?2)- 
Let p and a be the minimal fixed point states corresponding to Bj and B 2 , respectively. 
Then from Theorem [2] supp(p) = B\ and supp(cr) = B 2 . Similar to the proof of 
LemmafTOl we can take A sufficiently large such that p — \a = A + — Z\_ with A± > 0, 
supp(Z\_) = supp(er), and supp(zi + )_Lsupp(Z\_). Let P be the projection onto B 2 . 
Then 

PpP = XPaP + PA+P - PA-P = Act - A_ 

is a fixed point state as well. Note supp (PpP) C B 2 and the fact that a is the minimal 
fixed point state corresponding to B 2 . It follows that PpP = pa for some p > 0. Now 
if p > 0, then by Proposition[T]3 we have 

B 2 = supp(cr) = supp(PpP) = span(PlV') : \ip) € B{\. 

This implies dim(i?2) < dim(Pi), contradicting our assumption. Thus we have PpP = 
0, which implies i?i_Li?2- □ 

Proof of Theorem® Let b{ = dim(Bi), and d{ = dim(Z)j). We prove by induction 
that hi = d{ for any 1 < i < min{u, v}. Thus u = v as well. 

First, we claim 6i = d\. Otherwise let, say, b\ < d\. Then b\ < dj for any j. Thus 
by Lemma|2]2, we have 

V 

But we also have Bi±Tg, a contradiction as 

Suppose we have hi = d^ for any i < n. We claim fe„ = d„ as well. Otherwise let, 
say, b n < d n . Then from Lemma[2]2, we have 



©*-L©A 



and hence 



n-l 



0B,c0A. 

On the other hand, we have 

n n n — 1 n—X 

dim(0 Bj) = £ bt >J2 d *= dim (0 A), 

i— 1 i— 1 z— 1 z— 1 

a contradiction. □ 



Proof of Theorem\7\ The correctness of Algorithm|2]follows from Theorem|4] Lemma|9] 
and Corollary Q] For the time complexity, note that similar to Algorithm Q] the non- 
recursive part of the procedure Decompose(X) runs in time 0(n 6 ). Thus its total 
complexity is 0(n 7 ), as the procedure calls itself at most 0(n) times. 

Algorithm 12 first computes £oo("H), which costs time 0(n s ), by Lemma[7]l, and 
then feeds it into the procedure Decompose(X). Thus the total complexity of Algo- 
rithm's 0(n s ). a 

Proof of Lemma® Let P be the projection onto Tg = £ 00 (T~L)^. Similar to the proof 
of Theorem|4] we have 

q t = lim tv(P Bz £ k (p)) 

k— y oo 

does exist, and tr(Pg i £ 00 (p)) < %. Moreover 

1 = tr((J - P)£oo(p)) =Y i tv(P Bi S oc (p)) < y Qi = lim tr((J - P)£ k (p)) = 1. 

z — ' * — ' fc— >oo 

This implies g.; = tr(PBi^oo(/o))- □ 

Proof of Theorem^ The claim that 

Pr(phOG)=tr(P G £»(p)) 

is directly from Lemma |4] and Theorem |4] and the time complexity of computing this 
quantity follows from Lemma|7] 1 . □ 

Proof of Lemma\5\ As X is not orthogonal to B, we can always find a pure state 
\4>) G B such that Px\4>) ^ 0. Now for any \ip) G B, if there exists N such that 
tr(Px£ fe (V0) = for any k > N. Then \<j>) £ TZg(£ N+1 (ip)), which means that 
TZg(£ N+1 (^)) is a proper invariant subspace of B. This contradicts the assumption 
that B is a BSCC. Thus we have tr(Px£ l ('*P)) > for infinitely many i, D 

Proof of Lemma® Similar to Proposition 6.2 in ||2T1 and Lemma 4.1 in 11251 . we can 

show that the limit 

i N _ 
8^:= lim -Vf" 

JV->oo AT ^— ' 
n=l 

exists as well. For any \ip) G P, we claim that p^, := £ o(4') i s a zero operator. Oth- 
erwise, it is easy to check that p^, is a fixed point of £. Furthermore, from the fact 
that 

£(p 4 ,) = £(p 4 ,) + P x £(p4,)Px = P4, + P x £{p^)Px, 

we have tr(Px£(/?w,)) = as £ is trace-preserving. Thus Px£(p,p) = 0, and p^ is also 
a fixed point of £. Note that supp(p,p) C X 1 - n P. This contradicts with the assumption 
that B is a BSCC, by Theorem^] 

With the claim, and the fact that tr(£* (ip)) is non-increasing in i, we immediately 
have lim^oo tr^^)) =0. D 

Proof of Theorem\9\ Similar to the proof of Lemma|6] D 



To prove Theorem[10] we need the following lemma. 

Lemma 11. Suppose £ oc ('H) has a proper invariant subspace S. Then for any density 
operator p with supp(p) C £ 00 ('H) and any integer k, we have 

tiiP s £ k (p))=tr(P S p) 
where P$ is the projection onto S. 

Proof. By Lemma [TUl there exists an invariant subspace T such that £oo(H) = S ®T 
where 5 and T are orthogonal and invariant. Then by Theorem Q] we have 

1 > ti(P s £ k (p)) + tr{P T £ k (p)) > tr(P fl p) + tr{P T p) = tr(p) = 1. 

7hustr(P s £ k (p))=tr(P s p). D 

Proof of Theorem\TU\ We first show that y(G) is a subspace. Let \tfji) € y(G) and 
on be complex numbers, i = 1,2. Then there exists JVj such that for any j > iVj, 
supp(^'(Vi)) C G Let |V) = ai|Vi) + o a |^) and p = |^i)(V>i| + \fh)(H- Then 
|V') € su PP(/?)> an d from Propositions Q]l,[T]2, andQ~|4 we have 

supp(£ J (») C supp(£ J (p)) = supp(£ J '(^i)) V supp(£ J (V> 2 )) 

for any j > 0. Now \ip) € 3^(G) follows by letting N = max{iVi, N 2 }. 
We divide the rest of proof into six parts. 

- Claim l:y(G) D Vbcg 5 - 

For any BSCC B C G, from Lemmas|8]2 and|9]2 we have S C E^H). Further- 
more, as B is a BSCC, for any \ip) <G S and any i, svpp(£ l (ip)) C i? C G. Thus 
P C 3^(G), and the result follows from the fact that 3^(G) is a subspace. 

- Claim2:^(G) ^\J B c G B. 

For any |^) € 3^(G), note that p,p := £oo(ip) is a fixed point state. Let X = 
supp(p^). We claim \tp) <G X. This is obvious if X = £oo(T-L). Otherwise, as 
£oo(In) is a fixed point state and £ 00 ('H) = supp(£oo (-?%)) > by Lemma [TOl we 
have foo('H) = X © X\ where X 1 -, the ortho-complement of X in E^T-L), is 
also invariant. As X is again a direct sum of some orthogonal BSCCs, by Lemma|4] 
we have 

lim tr(P x r(V0) = tr(P Y £oc(V')) = li 

i— ^oo 

that is, 

lim tr(P xi r(i/;)) = 0. 

i— >oo 

Together with Theorem[T| this implies tr(P^^'0) = 0, and so \ip) G X. 



By the definition of y(G), there exists M > 0, such that supp(£ i (^)) C G for all 
i > M. Thus 



N _, W 



X = supp(lim i^(VO)=supp(lim ^^))CG. 

TV— s-oo iv * — ' JV— s-oo iV ' — ' 

i=l i=M 

Furthermore, since X can be decomposed into the direct sum of some BSCCs, we 
have X C Vbcg -^ Then the result follows by noting \ip) € X. 

- Claim 3: ^(G- 1 )^ C #(G). 

First, from Claims 1 and 2 above we have y(G^) C G^ and G' := ^(G^) 1 - is 
invariant. Thus G C ^(G^)^, and £ is a also CPTP map on G'; that is, the pair 
(G', £) is again a quantum graph. Furthermore, Claim 1 implies that any BSCC in 
G- 1 is also contained in ^(G^). Thus there is no BSCC in G'nG^. By Theorem^ 
for any |V') € G', lim^oo tr[(P G ± o£ fty)] = 0. Thus \ip) e X (G) by definition. 

- Claim4:<Y(G) C^fG 1 ) 1 . 

Similar to Claim 3, we have y{G^) C G^ and ^(G^) is invariant. Let P be the 
projection onto y(G- L ). Then Pq±PP g ± = P. For any |V>) € A'(G), we calculate 

tr(P(P G x o £)(V0) = tr(P G xPP G x£(V>)) = tr(P£(^)) > tr(P^), 

where the last inequality is by TheoremQ] Therefore 

= lim tr((P G ± o£) l (i/0) > lim tr(P(P G _L ° £)*(») > tr(P^), 

and so \ip) e^G 1 ) 1 . 



- Claim5:V B c G £^£°o(G- L ) ± . 

Suppose a BSCC P C G Then we have tr(P B 7 G i) = 0, and so tr(P B £ ! (/ G i)) = 
for any i > by Lemma fTTI Thus tr(Ps£ 00 (/ G i)) = 0, leading to B 1 
^(G^). Therefore B C £oa(G ) . Then the result follows from the fact that 
£oo(G ± )~ L is a subspace. 

- Claim6:f 00 (G J -) JL C\/ S cG- B ' 

By Corollary [TJ £ 00 (G ± ) ± can be decomposed into direct sum of BSCCs Bi. For 
any Bi, we have tr(PB i f 00 (7 G j.)) = 0. Thus tr(Ps i / G i) = 0, meaning that 
Bi _L G x . Therefore P.; C G, and the result holds. 

The invariance of A'(G) and y(G) is already included in Claims 1 and 2. This complete 
the proof. □ 

Proof of Theorem\72\ The correctness of Algorithm [3] follows from Theorems [TOland 
[TT1 The time complexity is again dominated by Jordan decomposition used in comput- 
ing £oo{p) and £ oc (G J -), thus it is Q(n 8 ). D 



